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These notes are not meant to he self-contained. They are for the most part 
a compilation of examples -- artificial to be sure -- illustrating basic concepts 
and controversial points which will be discussed in the lectures. It would be 
ideal from my point of view, and perhaps more meaningful to the reader, if the 
reader would give some preliminary thought to these examples prior to the time 
they will be jointly discussed. 

Topic 1 : Decisions under risk and uncertainty. 

1.1 An experiment involving objective and subjective uncertainties. 

You are given two urns each containing just red and black balls. Urn No. 1 
contains 50 red and 50 black balls. Urn No. 2 contains an unknown number 
of reds and an unknown number of blacks. 

Suppose you are given two options: 

Option No. 1 : Select a color (R or B), announce it, and then take a single 
random drawing from urn No. 1. 

Option No. 2: Select a color (R or B), announce it, and then take a single 
random drawing from urn No. 2. 

Suppose further, that no matter what option you choose the payoffs are 
as follows: 

a) If your selection differs from your drawing you get nothing. 

b) If your selection agrees with your drawing you gain $100. 

Answer the following questions, keeping in mind your financial position 
as of today . 

Question 1 : If you must choose either option No. 1 or option No. 2 which 
would you choose? 

Question 2 : If you were given the choice between taking no option or 
option No. 1 at a price, up to how much would you be willing to pay for 
option No. 1? 

Question 5 : If you were given the choice between taking no option or option 
No. 2 at a price, up to how much would you be willing to pay for option No. 2? 
























1*2. An experiment involving attitudes toward money and gambling. 


Prepare a set of complete and unambiguous instructions for your agent who 
will act in your behalf. Your agent will be given just one option which he 
can either accept or reject. However, you do not know the specific form of the 
option your agent will receive except that it will be of the following general 
form: It will involve a price p for the privilege of participating in a gamble 
with a 50-50 chance of receiving nothing or a reward of R dollars. Such an 
option will be denoted by (p, R). For example, if your agent is presented with 
option (27, 86) and your instructions tell him to accept, then: he pays $27; 
a fair coin is tossed; heads he gets $86 and tails he gets nothing. You are 
further told R will not exceed $1,000. 

Keeping your financial position, as of today , in mind, partition the (p, R) 
points into your own acceptance and rejection sets. For example, one possible 
partition might be of the form: 



1*3. A dynamic variation of 1.1 . 

We start out with the identical setup of example 1.1. The new gimmick goes 
as follows: 

Instead of a single trial there now will be a succession of ten trials. Each 
trial consists of the following four steps: 

Step 1 : Select a color (r or B) and announce it. 

Step 2 : Select an urn (no. 1 or 2) and draw a single random ball from the urn 
selected. 

5: You receive nothing if your announced color and the color of the with¬ 
drawn ball disagree; you receive $100 if they do agree. 

Step 4: Return the withdrawn ball to its urn. 























Formulate your strategy (in writing*.) for the play of this ten-trial "game". 
Your set of instructions constitutes a bona fide strategy if and only if it 
satisfies this simple test: An agent acting in your behalf and using only your 
instructions must know exactly what to do at a given trial conditional upon his 
information about past trials. He should never have to return to you for 
further clarification of a situation not adequately dealt with in your in¬ 
structions . 

In this example you are being asked what you would do if you had to play. 

A more difficult and interesting question is: "Up to what amount would you be 
willing to pay for the privilege of playing this game?" 

1.4. A team variation of example 1.2 illustrating risk sharing and insurance 

possibilities. 

You are the consultant to a team of four individuals. The team has been 
given the task of giving a complete set of instructions to an agent, acting in 
the team’s behalf, telling him what (p, R) options to accept and what to reject. 
Besides their external problem of joint acceptance or joint rejection they have 
an internal problem: How should they share the risks and profits accruing from 
an option that is jointly accepted? The internal and external problems are 
intrinsically intertwined and they wish you to draw up a reasonable contract 
for the internal behavior of the group and a set of joint instructions for 
their external behavior. 

The individual’s accept-reject strategies are given below: 




/ I 


The problem is a difficult one and there is no unique "answer". But 
nevertheless be prepared to discuss some of the guiding principles that you 
think might be reasonable. 
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1.5. An example motivating basic ideas of von Neumann Utility 

Mr. Belmont must choose between two risky options. Option 1 can lead to 
consequences A, B, C, E with probabilities .3, .2, .1, .4 respectively; 

Option 2 can lead to consequences A, C, D, F with probabilities .2, .5, .2 and 
.1, respectively. Symbolically, we have 



Option 



Consequences A, B,..., F are themselves complex entities which have psychological 
and economic implications to Mr. Belmont. 

Mr. Belmont has indicated the following personal preferences: 

1) The consequences are ranked A, B, C, D, E, F from the least preferred 
to the most preferred. 

2) Consequences B, C, D, E were each independently compared to a hypo¬ 
thetical option which put (l-p) weight on A and p weight on F, which symbolically 
is referred to 

"a f" 

_1-P P_' 

The results of Mr. Belmont's comparisons are: 


(i) B is indifferent to 



(ii) C is indifferent to 



(iii) D is indifferent to 


r* 

A 

.3 

L. 



(iv) E is indifferent to 


A F 
2 .8 
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Question 1 : Using Mr. Belmont’s preferences in 1) and 2(i) to 2(iv) which 
option should he choose? 

Question 2 ; What are the principles you invoked to reach your conclusion? 

1.6. An example illustrating a utility of money curve in risk sharing. 

Mr. Chelsea, is an oil wildcatter. He is constantly faced with different 
options whose payoffs are not certain. A typical option might he of the 
following variety: 


Consequence: 

Present monetary value 
of the consequence: 

Probability 


-$50,000 

.5 


B 

-$ 10,000 

.2 


$100,000 

.2 


$200,000 

.1 


Mr. Chelsea associates to each such option a monetary, certainty, present 
value equivalent which is computed as follows: He first constructs a conversion 
function, or a utility function, which associates to each dollar amount X say, a 
number u(x) say, viz: 
















For each option he then computes the expected value of the u's and then 
reconverts this expected value back into a dollar certain figure. To illustrate 
with the above option: 


Present Monetary Value of 
the consequence: 

-50,000 

-10,000 

3 

100,000 

% 

200,000 

u value 

-1.2 

-.2 

1.0 

1.3 (say) 

Probability 

.5 

.2 

.2 

.1 


E. V. = (-1.2).5 + (-.2).2 + (1.0).2 + (l.3).l 
= -.31. 

Since u(-$17,000) = -.31, Mr. Chelsea asserts he would be indifferent between 
giving up $17,000 certain and taking the risky option. 

Mr. Chelsea periodically reviews his utility curve — especially when there 
is a change in his asset position. 

Question 1 : If Mr. Chelsea were offered the above option or any fraction of it 
he chose, and he does not have any competing capital "deals", what should he do? 

Question 2 : How would you go about drawing your own utility curve? To be 
specific suppose a single deal were offered to you with monetary consequences 
and associated probabilities. Not knowing the specific numbers involved (except 
that the payoffs are in the range from -$1000 to +$5000), prepare a utility 
function to give to your agent to act in your behalf. Remember, play the role 
that it is your money and you have your bills to pay at the end of the month etc. 
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Topic 2 Decisions leading into decisions . 

2.1. Example illustrating principle of working backwards in time: A drunkard 
has x dollars. He spends $1 cover charge to get into a bar, spends l/2 
of his money in the bar, and spends a dollar to get out. After five 
repetitions he is broke. How large is x? 

2.2. A less facetious example illustrating a similar point. A warehouse 
problem 

Mr. Medford owns a warehouse. He tries to fill his warehouse by 
buying commodities when costs are low and unloading his warehouse when 
prices are high. Assume time is discretized into periods, and each 
period is decomposed into a selling part followed by a buying part. 

Mr. Medford knows (let's divide our difficulties by assuming them away'.) 
that the selling prices(p's) and buying costs (c's) per warehouse full 
of each of 3 commodities are (in thousands): 

Period 



Commodity 1: 4 97 38 64 75 

2: 8 5 7 9 8 10 11 12 10 

3: - 11 15 13 15 12 13 11 14 19 

Assume that initially the warehouse is empty and proceed on the boundary 
condition that it must also be empty at the end of the fifth period. Find 
an optimal buying and selling strategy for Mr. Medford. 

Hint: Argue that: 

a) There is never a. need to have a product mix in the warehouse. 

Hence the warehouse can only be in one of four states: S Q -empty, 
S^-full of commodity 1, Sg-full of commodity 2, S^-full of commodity 3. 

b) The values of being in states S , S,, S 9 , in the selling part of 

O _L Cj> O 

period 5 are 0, 7, 12, 14 respectively. 


c) Work backward. 
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How does the analysis change 

i) if there is a storage cost from period to period? 

ii) if there is a discount factor from period to period? 

iii) if Mr. Medford has a cash constraint? 

2.5. A variation of 2.3 illustrating the use of natural horizons. 

Mr. Arlmont has a warehouse which is equipped to handle only one 
commodity. He starts with an empty warehouse and knows the p^'s and c^’s 
for the next five periods. He does not have any constraint to have an 
empty warehouse sometime in the future. The data facing him is as 
follows. 



20 10 11 8 17 20 10 15 16 6 ? ? ? 


What should Mr. Arlmont do in the first period? Is it possible to 
determine what Mr. Arlmont should do in periods 2, 3, 4, and 5 without 
knowing p g , c g , p ...? 

Hint : Show that no matter what Pg, Cg, p.^,... are, it is optimal to have a full 
warehouse going into the selling part of the fifth period. This now works 
as a boundary constraint from which a backward program can start. 

2.4. A decision flow chart involving chance moves. 

Waco Wildcat Inc . 

Honest John Waco, Wildcatter extra-ordinaire, has just finished examining 
a geologist's report on a corner plot of the Bumsteer Ranch. They suspect this plot 
to have oil in it — someplace. Honest John has three options open to him: 

1. Don't drill. Let the plot rest untapped. 

2. Drill on the strength of the report he now has before him. 

3. Conduct further seismological tests, then decide whether or not to 
drill. 

In his mind he reviews the situation as follows: 'suppose I drill solely on the 
strength of this Rock of Ages Geological Survey Inc. report before me? Their break¬ 
down of drilling costs and estimated present worth of oil in this plot gives me the 
following picture of a gamble on drilling now. 














STATE 



Dry 

Wet Natural Gas 

Wet Gas and Oil 

Oil 

Drill now: 

Gain or Loss 

-$100,000 

$50,000 

$100,000 

$200,000 

Subjective 
Probability of 
State 

.3 

.4 

.2 

.1 


The report indicates that the estimates of 'Probability of State' are quite subjec ¬ 
tive . They are based on the geologists' weighing of four factors: 

a) past experience with similar well states; 

b) external examination of the Bumsteer plot; 

c) number of producing wells in the near vicinityj 

d) their 'hunches' as to the chances of hitting any 
one of the listed states. 

Thus the Subjective Probabilities of State represent the geologists' willingness 
to place hypothetical bets as to the state of the well at odds by the bottom row 

if I.' 

'Rather than decide on the basis of the above information alone, I can 
conduct further seismological tests, then make up my mind. The geologists' inform 
me that such tests will cost $25,000. They also inform me that such tests will not 
yield perfect information on the state of the plot. Here is their table picturing 
the venture after the tests:' 


II 

Conditional Probability of Seismic Information 

Given the Well State 

STATE 


Type of 
Information 

Dry 

Wet Natural Gas 

A 

1.00 

.25 

B 

0 

.75 

C 

0 

0 


1.00 

1.00 

Subjective 

Pr. of State 

.3 

.4 


Wet Natural Gas and Oil Oil 

0 0 

1.00 0 

0 1.00 

1.00 1.00 

.2 .1 





























Honest John has millions in the bank. At present, this is the only deal 
to which he has access. What should he do? 

Remarks 

1. From Table II and the subjective probabilities of states, show how 
to derive the following table: 



Seismic 

Information 



Type of 

Information 


States 

A 

B 

C 

Dry 

.75 

0 

0 

Wet Nat. Gas 

.25 

.60 

0 

WNG and Oil 

0 

.40 

0 

Oil 

0 

0 

1.00 


1.00 

1.00 

1.00 

Probability of 




type of information 

.4 

.5 

.1 

First make a table 

of joint probabilities of 

occurrences 


of seismic information). 

2. After working 1. above, can you outline Honest John’s optimal course 
of action for him? 
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2.5. An infinite stage stationary decision problem: 


Ten balls labelled 1, 2, ...,10 are placed in an urn. Now consider 
the following two options: 


Option-1 : Draw a ball at random. If it is marked x, you receive x dollars. 

Option 2 : Pay $1. Draw a ball at random. If it is marked x you have the choice of 

a) receiving x dollars, or 

b) returning the ball and starting over. 

Which option would you choose? 


_ — 




Hints: 


a) If v is the expected value of an optimal strategy with option 2 then in 
terms of v what is the optimal rule for continuation? For example if v were 5.3 
would you continue sampling if x = 6? 

b) The number v satisfies the functional equation: 


v = min 


{- 



!■ 


y, y integral 
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2.6. An (extensive) game tree. 

Consider the following two-person game: 



LStd-rtrJ 


Key 

Move 1: Chance move. Nature or a referee chooses or R^ each with 
probability .5. 

2: PI. i»s move. PI. I is in information set 1 A. He does not know 
if or R^ occurred in move 1. He has the personal choice of a or 
b. The game terminates after 1*s move if R^ occurs on move 1. 

3. Chance Move. R g are chosen with probabilities 1/4, 3/4 respectively. 

Lg, Rj are chosen with probabilities l/5, 4/5 respectively. 
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Move 4: PI. 2’s move. PI. 2 knows whether he is in information set 2 A_, i 8^ 
or 2 C. If in 2 B, pi. 2 does not know whether he arrived there 
via (L^, a, Rg) or (L^, b, Lj). PI. 2 has choices c or d in 2 A, 
e or f in 2 B, g or h in 2 C. Payoffs at end points represent 
monetary changes from PI. 2 to PI. 1. 


Analysis of strategies : 

Player 1 has one information set and two choices in it. Hence player 1 has 
2 strategies which we shall label a and b. Player 2 has three information sets 
2 A, B, C. A strategy for 2 consists of a choice £ or d in 2 A, e or f in 2 B, 
g or h in 2 C. If the choices are c, e, and g say, we will denote 2*s strategy 
by (c, e, g). 


PI. 2's strategies 


PI. I 1 s a 
Strategies b 


(Cjgjg) 

r 

-4 



-1 

-2 


(d>e,g) 

-1.5 

.1 


(a,f,g) 

1.5 

-2 


(c*e>h) 

-4 

4.9 


-1 

2.8 


(d,e,h) 

-1.5 

4.9 





Payoffs from PI. 2 to PI. 1 


From the table of payoffs, or directly from the game tree, we note that 
strategies (3,e,g), (d,f,g), (c,e,h), (c,f,h), (d,e,h) and (d,f,h) are dominated. 


Topic 5 Two-person games. 

Reflect on the following games. In each take the role of player 1. Your 
adversary is a member of this class, who will remain unknown to you. You must 
choose a strategy from your available domain in order to attempt to maximize your 
utility return. But remember your adversary has similar motives. 

3.1 An illustration of game-type thinking and domination : 

























-l¥- 

2* s strategies 



*1 

P 2 

^3 

^4 

l's a l 

(2,6) 

(3,3) 

(12,4) 

(13,2) 

Strategies a g 

(4,1) 

(4,1.5) 

(i.o) 

(4,1) 

a 3 

(12,0) 

(3,6) 

(8,-D 

(10,5) 


Payoff Table 


Key : For example if 1 choose a g and 2 chooses 8^ the payoff is (4,1) which means: 

1 receives 4'utilies of satisfaction 1 and 2 receives *1 utile of satisfaction.' 
Remember utiles are like temperature scales - they have an arbitrary origin 
and unit of measurement. 

3.2 A zero-sum game with an equilibrium in pure strategies: 


PI. 1: 


PI. 2 


*1 


h 



*4 



3 

3 

4 
4 
3 


0 

8 

5 

2 

0 


2 

20 

5 

25 

20 


Payments of Pi. 2 to PI. 1 in Dollars 


(introduction to the Minimax Theorem). 
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3.3. A zero-Siam game without an equilibrium in pure strategies : 


PI. 2: 


PI. 1 






(3/4 P 1 , 1/4 p 2 ) 


°1 

3 

1 

5/2 

1 

a 2 

2 

4 

5/2 

< 


5/2 

5/2 

5/2 

j 

(Statment of the Minimax Theorem) 



5.4. A non-zero-sum game illustrating: 

a) Efficacy of a power stragety 

b) Non-interchangeability and non-equivalence of equilibrium pairs. 

c) Advantage of pre-play communication. 

d) Possibilities of temporal collusion. 



I 






( 2 , 1 ) (- 1 ,- 1 ) 

(- 1 ,- 1 ) ( 1 , 2 ) 


5.5. A non-zero-sum game illustrating efficacy of a binding pre-play threat, use 
of side payments and temporal policing without pre-play communication. 


I 



X 



(1,2) (3,1) 


(0,-200) (2,-300) 

Payments in dollars 


5.6. A non-zero-sum game illustrating non-pareto Optimality of a very stable 
equilibrium pair. What is rationality? 
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C 


PI. 1 


a. 


a 


2 


Pi. 2 



(9,9) (-10,10) 


(10,-10) (-9,-9) 

Payments in dollars 


(Play the role that your sole motivation is to maximize your own expected monetary 
return) 

3.7. Temporal repetition of 3.6. An illustration of (a) another inadequacy of 
the equilibrium concept, (b) game teaching or learning. 

Imagine that you are player 1 pitted against an unknown adversary 
(someone in this room) and that you are going to play game 3.6 not once 
but 5 times (trials). After each trial you will be told your opponent's 
choice in that trial. Since we do not have time to actually play the game 
5 times, please formulate your strategy for the entire 5 trials. Your 
strategy must uniquely dictate your choice at any trial for any potential 
set of historically past choices. 

Roughly how would you alter your policy if the game were to be repeated 
100 times instead of 5 times. 



















